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© The present invention relates to a method and an apparatus for compensating for color in color images for 
use in an image processing field which is employed for three dimension computer graphics and so on. 
Conventionally, a color compensation method for color images for use in this field has not made any 
compensation between a lightness of a texture itself representing a pattern on the surface of an object and an 
intensity of the surface of the object derived by an intensity calculation when an image is generated, so that the 
generated image has been extremely unnatural. The present invention performs a color compensation for color 
images by making a luminance of texture data coincident with an intensity derived by an intensity calculation. 
Also, a lightness compensation is performed for a color image according to a display scene. From measuring 
results of color changes of plural colors in a uniform color space, a color change of arbitrary texture data under a 
chromatic color light source is represented and compensated for. 
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METHOD AND APPARATUS FOR COMPENSATING FOR COLOR IN COLOR IMAGES 



BACKGROUND OF THE INVENTION 

This invention relates to a method and an apparatus for compensating for color in color images in the 
image processing field. Conventionally, in the three-dimension computer graphics field, any compensation 

5 has not been made between a luminance of a texture Itself representing a pattern on the surface of an 
object and an intensity of the surface of the object derived by an intensity calculation when an image is 
generated. For this reason, a generated image has a lightness different from that of the original object and 
therefore appears awkward or unnatural. Also, display characteristics of display apparatus has not been 
considered with respect to generation of images, which results in displaying unnatural images having a 

10 changed hue. Further, when a colored light source is used, there is not provided a method for representing 
a change in color of a texture, so that natural images have not been generated under such colored light 
source. 



75 SUMMARY OF THE INVENTION 

It is an object of the present invention to provide a definite formula representing a relationship between 
an intensity of an object derived by an intensity calculation and a lightness or a luminance of a texture by 
the use of a uniform color space, to thereby generate an image close to a photograph. 
20 To achieve the above object, the present invention employs the following methods. In the discussion 
below, the luminance and lightness are assumed to be interchangeable with each other by a color-space 
conversion. 

Color image data is converted to a uniform color space, and a luminance of an object is calculated from 
a ratio of an intensity on the surface of the object derived by an intensity calculation to a maximal intensity, 

25 the reflectance of the object and the luminance of a standard white. 

When a lightness of a surface irradiated with a chromatic color reference light is calculated from a 
lightness of the surface irradiated with an achromatic color reference light, such lightness is calculated by a 
standard white irradiated with the achromatic and chromatic color reference lights and a mapping 
representing a displacement amount of an arbitrary color in a color space which is calculated based on 

30 chromaticity coordinates of a standard color patch. 

When the lightness of color image data is to be changed, a saturation is changed in proportion to a 
changing rate of the lightness within a range which does not exceed the lightness of the standard white 
irradiated with the chromatic color reference light, or the saturation is decreased in proportion to the 
changing rate of the lightness. 

35 When a range of a display luminance of output images to be displayed is to be compensated for, the 
display luminance of an image output apparatus is calculated from a median display luminance and a 
maximal display luminance and a minimal display luminance and a luminance of color image data. 



40 BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a block diagram schematically showing an embodiment of a method and an apparatus for 

compensating for color in color image according to the present invention; 

Fig. 2 is a diagram showing how an intensity is calculated by a mutual reflection; 
45 Figs. 3A and 3B are diagrams showing the coordinates of a standard color patch in a color space 

irradiated with an achromatic color reference light and a chromatic color reference light; 

Fig. 4 is a diagram showing an example of measuring a lightness, a saturation and a hue of a standard 

color patch having a lightness of 70 when irradiated with a chromatic color reference light Tc; and 

Fig. 5 is a diagram representing an example of handling a saturation which may be needed by a change 
so in lightness. 

DESCRIPTION OF THE PREFERRED EMBODIMENTS 

An embodiment of a method and an apparatus for compensating for color in color Images according to 
the present invention will hereinafter be explained with reference to the accompanying drawings. Fig. 1 
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shows an embodiment of a method and an apparatus for compensating color in color images according to 
the present invention. Rg. 2 shows how an intensity is calculated by a mutual reflection. Figs. 3A and 3B 
are diagrams showing the coordinates of a standard color patch in a color space irradiated with an 
achromatic color reference light and a chromatic color reference light. Rg. 4 is a diagram showing an 

s example of measuring a lightness, a saturation and a hue of a standard color patch having a lightness of 70 
when irradiated with a chromatic color reference light Tc. Rg. 5 is a diagram representing an example of 
handling a saturation which may be needed by a change in lightness. 

A color conversion unit 1 converts the coordinates of each pixel of texture data previously inputted by 
an image inputting apparatus such as a scanner to a uniform color space. The uniform color space is 

70 defined as a space in which a difference between every two chromaticity points is all equivalent. In this 
embodiment, a CIELAB uniform color space is given as an example of the uniform color space and the 
texture data is assumed to be represented by an RGB color system, wherein R, G and B designate 
coordinates respectively representing red, green and blue components of respective pixels of an image. 
The color conversion unit 1 converts data in the RGB color system through an XYZ color system to L\ 

15 a*, and b* which is one of the uniform color spaces. A series of these conversions are given by the following 
formulae (1) and (2), wherein L* represents a lightness, and a* and b" together represent a hue and a 
saturation. The hue is given by tan -, (b7a*). and the saturation by (a**a* + b* # b*) 1/2 . Further, X, Y and Z 
represent tristimulus values represented by the XYZ color system, wherein Y corresponds to the luminance. 

20 
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.B. 





L* = 116(Y/Y 0 ) 1/3 - 16 

a" = 500UX/XO) 1 * - (Y/Y 0 ) 1/3 1 

b* = 200[(Y/Y 0 ) 1 ' 3 - (Z/Zo) 1/3 ] (2) 

where Xo, Y 0 and Z 0 represents values X, Y and Z for the standard white. 

Next, an intensity processing unit 2 calculates an intensity by the use of data indicative of the shape of 
an object, the reflectance of the surface of the object, which is one of attribute data representing optical 
characteristics, and light source data. One of methods for calculating the intensity may be effected by 
mutual reflection. 

The intensity calculation by mutual reflection calculates an intensity of the surface of an object from the 
position, shape and light emitting characteristics of light sources, the position and area of the object which 
are included in shape data of the object, and optical characteristics representing a condition of the surface 
which is an attribute of the object. Such calculation of an intensity of the surface of an object is achieved by 
first calculating an intensity by directly emitted light defined by light sources and thereafter calculating an 
intensity by mutual reflections between objects which is an indirect light 

Rg. 2 shows an intensity calculation by mutual reflection. In Rg. 2, a shape of an object is represented 
by a rectangle. The unit of the intensity calculation is called "a patch ". It is assumed that a patch 22 is 
provided with an intensity by a direct light emitted from a light source 21 . Also, an intensity by an indirect 
light is mutually given between the patch 22 and a patch 23. The intensity by the direct light is determined 
by the magnitude of the light source 21 and the distance between the light source 21 and the patch 22. For 
example, assuming that the magnitude of the light source 21 is represented by G, and the distance 
between the light source 21 and the patch 22 by r 2 i.22, when the magnitude of the light source is inversely 
proportional to the square of a distance, a direct light intensity is given by the following formula (3): 

'direct = G/(r 2 i,22 * ^1,22) (3) 

An intensity ! 23i 23 by the indirect light from the patch 23 to the patch 22 is determined by an intensity 
I23 of the patch 23, a reflectance P 23 of the surface of the patch 23, an area A23, an angle 4> formed by a 
line 26 and the normal of the patch 23, an angle ^ formed by the line 26 and the normal of the patch 22, 
and a distance r 22 ,23» as given by the following formula (4): 

123,22 = l23*P23*A 2 3COS^*COS^/(r22,23" r 22,23) ( 4 ) 

An intensity to the patch 22 is determined by the sum of an intensity by the direct light and an intensity 
by indirect lights from all patches . Since the indirect light is generated by mutual reflections, an intensity 
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calculation for the indirect light is performed by iterative calculations until a convergency is gotten. 

As the results of the intensity calculations, it is assumed that a maximum intensity value is expressed 
by Imax. an intensity of a patch i by li, and a reflectance of the surface of the patch i by pi. If the value Y for 
the maximal intensity value is replaced by a value Yo which is the value Y for the standard white, a value Y in 
5 for a light incident to the patch i is given by the following formula (5): 

Y ?n = (li/lmaxTYo (5) 

A value Yi, which is a value Y for a light reflected by the patch i, is equal to the product of the value Y 
for the incident light and the reflectance pi of the patch i, as shown by the following formula (6): 
Yr = pi-Y in — ~ 

10 = pi-(H/l ma x)-Y 0 (6) 

Next, reference is made to a color space mapping unit 4. In this embodiment, chromatic and achromatic 
color reference lights, the standard white and standard color patches are employed to calculate a mapping 
which represents a displacement amount of an arbitrary color in the color space. For the standard color 
patches, a plurality of color patches are employed which are uniformly distributed in the uniform color 

75 space. In this embodiment, a standard color patch having a lightness of 70 selected from these standard 
color patches, is given as an example. Image data generated when the standard white is irradiated with an 
achromatic color reference light Tn and a chromatic color reference light Tc is represented by the CIELAB 
uniform color space as (L* max , 0, 0) and (L* w , a* w , b* w ), respectively. Also, image data generated when the 
standard color patch having a lightness of 70 is irradiated with an achromatic color reference light Tn and a 

20 chromatic color reference light Tc is represented by the chromaticity coordinates as (L* n , a* n , b* n ) and (L* CJ 
a* c , b* c ), respectively. Figs. 3A and 3B shows the coordinates of the standard color patch in the color space 
irradiated with the achromatic and chromatic color reference lights. Also, Fig. 4 shows an example of 
measuring a lightness, a saturation and a hue when the standard color patch having a lightness of 70 is 
irradiated with the chromatic color reference light Tc. 

25 In the color space mapping unit 4, a mapping s(e) is defined such that (L* max , 0, 0), (L* w , a* w , b* w ), (L* n , 
a* n , b* n ) and (L* c , a* c , b* c ) satisfy the formula (7). Assuming that Q is an angle extending over the both sides 
of a reference plane which links the chromaticity coordinates of the chromatic color light on the standard 
color patch irradiated with the chromatic color light and an achromatic color axis, as shown in Fig. 3B. The 
mapping s(0) can be approximated, for example, as expressed by the following formula (8), due to a 

30 distortion of the color space caused by an irradiation with the chromatic color light. References Bo and m 
designate values representing the color purity of the chromatic color light source Tc which are constants 
determined by experimental results. 

L c = (L*w/'L.*max) * L*n 

a* c = (LVL- max )-a* n + s(e).(LVL* niax )-a* w 

35 b* c = (LVL* ma x) # b* n + S(0)-(LyL*max)'b* w ( 7 ) 



s(9) = rl + m(9^0 o ) 

(8) 

Ll (9)9 0 ) 

Further, in the color space mapping unit 4, (L* t , a* t , b* t ) on the surface, which is irradiated with the 
chromatic color reference light Tc, is calculated by the following formula (9) based on (L* t a*, b*) converted 
by the color conversion unit 1 : 
L* t = (LVL* ma x)-L* 

a* t = (LVL* ma x)-a* + s^J^LVL^-aV 

b\ = (LVL* m ax) # b* + s<0)-(L7L* max )-b* w (9) 

In a color compensation unit 5, (L* t , a* t , b* t ) calculated in the color space mapping unit 4 is 
compensated for the lightness by the use of a lightness compensation coefficient 0 which is determined 
according to an intensity distribution of the surface of an object. Since the actual luminance of an image is 
varied depending upon image output characteristics of a display (7), the coefficient & is given by the 
following formula (10) with a coefficient representing a change in luminance being designated by a. As 
shown in the formula (10), the coefficient £ is multiplied with Y 0 . 

(L*new. a* new , b* new ) after the lightness compensation is calculated by the formulae (11), with the 
saturation being proportional to a lightness changing rate such that (L* new , a* new , b* new ) will not exceed the 
lightness value L* w of the standard white irradiated with the reference light: 
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Y„ew = «*Y, 

= pi*(li/"max)*Yo 

= j8*Y 0 

B = a'pi'OWmax) (10) 
5 L*„ew = min (/S 1/3 '(L*, + 16) - 16, L' w ) 

3*new = k*3*t 

b*new = k-b* t (11) 



The lightness compensation coefficient £ in the formula (10) should have a value greater than one for 
10 increasing the lightness and a value less than one for decreasing the lightness. Also, min ( ) is a function for 
returning the smaller one of two arguments, and the coefficient k in the formula (11) is defined by the 
following formula (12): 
k = LWL* t (12) 

Alternatively, the coefficient k may be defined by the formula (13). In either case of defining the , 
15 coefficient k by the formula (12) or (13), it is possible to solely change the saturation and the lightness 
without changing the hue, wherein the saturation is changed in proportion to a lightness change. A 
saturation S ne w is calculated by a formula (14) according to a saturation compensation. Fig. 5 shows an 
example of a saturation handling which may be needed in consequence of a change in lightness. 



20 

V L W L *t < L *new^ L V 

25 (100 - L* new )/<100 - L* t > < L *new= L V 

(13) 
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Snew = (a"new2 + b* neW 2) 1/2 (14) 



In - Fig. 5, (L* new i. a* new i. b* new i) represents a compensation for increasing the lightness of the original 
(L* { , a*,, b* t ), and (L* neWl a* ne w» b* ne w) a compensation for decreasing the lightness of the same. 

A display luminance conversion unit 6 performs a color compensation in accordance with characteristics 

35 of a display 7. Such color compensation is achieved by the coefficient a employed in the formula (10). To 
determine a in the formula (10), display characteristics of the display 7 is used. The intensity of a patch is 
designated by li. Also, as the display characteristics, a maximum display luminance value of the display 7 is 
designated by V d i SP , ma x, a minimum display luminance value of the same by V disp , min , a maximum intensity 
of a display scene by l SC8n e. max. and a minimum intensity of the same by l SC8 ne. min- Then, the maximum and 

4o minimum intensities of the display scene are determined, for example, by a formula (15), as a method of 
matching them with the maximum and minimum luminance of the display 7. Alternatively, there is also a 
method of determining the maximum and minimum intensities of the display scene so as to make a median 
value l S cene. mean of the intensity of the display scene equal to a median display luminance V dlsPi mean of the 
display 7. The latter method is determined as shown in the formula (16). 



a = 



V disp,max V disp,min 

i -I ~ * ^ I i" I scene / min^ +V disp / min 

L scene, max scene, mm 



/ 



v disp.max (15) 
or = (tylscene,mean) * (Vdisp.mean/Vdisp.max) C®) 

As explained above, the present embodiment can produce effects as described below: 

A lightness of texture data can be compensated for in accordance with the result of an intensity 

calculation with respect to the surface of an object, based on a ratio of an intensity to a maximum intensity, 

a reflectance of the object and the luminance of the standard white. 

A lightness on a surface irradiated with a chromatic color reference light can be derived from a 

lightness on the surface irradiated with an achromatic color reference Might by the use of a mapping 
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representing a displacement amount of an arbitrary color in the color space which is calculated on the basis 
of the chromaticity coordinates of a standard color patch which is being irradiated with the chromatic and 
achromatic color reference lights. 

Further, for changing a lightness of data representing a color image, an image processing method is 
5 provided which changes a saturation in proportion to a lightness changing rate, whereby a discrepancy in 
hue can be suppressed when a lightness of color image data inputted from an image inputting apparatus 
such as a color scanner is to be changed. 

Furthermore, a natural image can be displayed on an image output unit by providing display 
characteristics of the image output unit. 
w The present invention is not limited to the above described embodiment, and a variety of modifications 
can be made based on the spirits of the present invention. Therefore, these modifications will not be 
excluded from the scope of the present invention. 



75 Claims 

1. A method for compensating for color in color images in a combination comprising a color conversion unit 
(1) for performing a color conversion on color image data to calculate a luminance, a lightness, a saturation 
and a hue; an intensity processing unit (2) for calculating an intensity of the surface of an object, a 

20 maximum intensity thereof, a maximum intensity of a display scene, a minimum intensity of said display 
scene, and a median value of the intensity of said display scene by the use of shape data representative of 
a shape of said object, light source data representative of a position and light emitting characteristics of a 
light source and attribute data representative of optical property of said surface of said object; and a display 

™ luminance conversion (6) unit for converting to a display luminance of a display (7) by the use of said 

25 lightness, said saturation and said hue: 

said method being characterized by calculating a luminance of said object from a ratio of the intensity of 
said object to said maximum intensity, both calculated by said intensity processing unit, a reflectance of 
said attribute data of said object, and a luminance of a standard white. 

2. A method for compensating for color in color images in a combination comprising a color conversion unit 
30 (1 ) for performing a color conversion on color image data to calculate a luminance, a lightness, a saturation 

and a hue; an intensity processing unit (2) for calculating an intensity of a surface of an object, a maximum 
intensity thereof, a maximum intensity of a display scene, a minimum intensity of said display scene, and a 
median value of intensity of said display scene by the use of shape data representative of a shape of said 
object, light source data representative of a position and light emitting characteristics of a light source and 
35 attribute data representative of optical property of said surface of said object; and a display luminance 
conversion unit (6) for converting to a display luminance of a display (7) by the use of said lightness, said 
saturation and said hue: 

said method being characterized by calculating a lightness of a surface irradiated with a chromatic color 
reference light, when it is derived from a lightness of said surface irradiated with an achromatic color 
40 reference light, by a mapping representative of a displacement amount of an arbitrary color in a color 
space, said mapping being calculated based upon chromaticity coordinates of a standard white and a 
standard color patch when they are irradiated with said achromatic and chromatic color reference lights. 

3. A method for compensating for color in color images in a combination comprising a color conversion unit 
(1) for performing a color conversion on color image data to calculate a luminance, a lightness, a saturation 

45 and a hue; an intensity processing unit (2) for calculating an intensity of a surface of an object, a maximum 
intensity thereof, a maximum intensity of a display scene, a minimum intensity of said display scene, and a 
.median value of intensity of said display scene by the use of shape data representative of a shape of said 
object, light source data representative of a position and light emitting characteristics of a light source and 
attribute data representative of optical property of said surface of said object; and a display luminance 

so conversion unit (6) for converting to a display luminance of a display (7) by the use of said lightness, said 
saturation and said hue: 

said method being characterized by changing, for changing lightness of said color image data, its saturation 
in proportion to a lightness changing rata within a range in which said lightness of the color image data 
does not exceed a lightness value of a standard white when irradiated with a chromatic color reference light, 
55 or by decreasing its saturation in proportion to the lightness changing rate. 

4. A method for compensating for color in color images in a combination comprising a color conversion unit 
(1) for performing a color conversion on color image data to calculate a luminance, a lightness, a saturation 
and a hue; an intensity processing unit (2) for calculating an intensity of a surface of an object, a maximum 
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intensity thereof, a maximum intensity of a display scene, a minimum intensity of said display scene, and a 
median value of intensity of said display scene by the use of shape data representative of a shape of said 
object, light source data representative of a position and light emitting characteristics of a light source and 
attribute data representative of optical property of said surface of said object; and a display luminance 
5 conversion unit (6) for converting to a display luminance of a display (7) by the use of said lightness, said 
saturation and said hue: 

said method being characterized by calculating, for compensating for a display luminance range of an 
output image, a display luminance of said display (7) from a maximum display luminance and a minimum 
display luminance of said display (7), a median value of the display luminance and a luminance of color 
70 image data. 

5. An apparatus for compensating for color in color images comprising: 

a color conversion unit (1) for performing a color conversion on color image data to calculate a luminance, a 
lightness, a saturation and a hue; 

an intensity processing unit (2) for calculating an intensity of the surface of an object, a maximum intensity 
75 thereof, a maximum intensity of a display scene, a minimum intensity of said display scene, and a median 
value of intensity of said display scene by the use of shape data representative of a shape of said object, 
light source data representative of a position and light emitting characteristics of a light source and attribute 
data representative of optical property of said surface of said object; 

a display luminance conversion unit (6) for converting to a display luminance of a display (7) by the use of 
20 said lightness, said saturation and said hue; and 

a luminance calculation unit (3) for calculating a luminance of said object from a ratio of the intensity of said 
object to said maximum intensity, both calculated by said intensity processing unit, a reflectance of said 
attribute data of said object, and a luminance of a standard white. 

6. An apparatus for compensating for color in color images comprising: 

25 a color conversion unit (1 ) for performing a color conversion on color image data to calculate a luminance, a 
. lightness, a saturation and a hue; 

an intensity processing unit (2) for calculating an intensity of a surface of an object, a maximum intensity 
thereof, a maximum intensity of a display scene, a minimum intensity of said display scene, and a median 
value of intensity of said display scene by the use of shape data representative of a shape of said object, 
30 light source data representative of a position and light emitting characteristics of a light source and attribute 
data representative of optical property of said surface of said object; 

a display luminance conversion unit (6) for converting to a display luminance of a display (7) by the use of 
said lightness, said saturation and said hue, and 

a color space mapping unit (4) for calculating a mapping representative of a displacement amount of an 
35 arbitrary color in a color space on the basis of chromaticity coordinates of a standard white and a standard 
color patch when they are irradiated with said achromatic and chromatic color reference lights. 

7. An apparatus for compensating for color in color images comprising: 

a color conversion unit (1) for performing a color conversion on color image data to calculate a luminance, a 

lightness, a saturation and a hue; 
40 an intensity processing unit (2) for calculating an intensity of a surface of an object, a maximum intensity 

thereof, a maximum intensity of a display scene, a minimum intensity of said display scene, and a median 

value of intensity of said display scene by the use of shape data representative of a shape of said object, 

light source data representative of a position and light emitting characteristics of a light source and attribute 

data representative of optical property of said surface of said object; and 
45 a display luminance conversion unit (6) for converting to a display luminance of a display (7) by the use of 

said lightness, said saturation and said hue; and 

a color compensation unit (5) for changing lightness of said color image data by changing its saturation in 
proportion to a lightness changing rate within a range in which said lightness of the color image data does 
not exceed a lightness value of a standard white when irradiated with a chromatic color reference light, or 
so by decreasing its saturation in proportion to the lightness changing rate. 

8. An apparatus for compensating for color in color images comprising: 

a color conversion unit (1) for performing a color conversion on color image data to calculate a luminance, a 
lightness, a saturation and a hue; 

an intensity processing unit (2) for calculating an intensity of the surface of an object, a maximum intensity 
55 thereof, a maximum intensity of a display scene, a minimum intensity of said display scene, and a median 
value of the intensity of said display scene by the use of shape data representative of a shape of said 
object, light source data representative of a position and tight emitting characteristics of a light source and 
attribute data representative of optical property of the surface of the object; and 
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a display luminance conversion unit (6) for converting to a display luminance of a display (7) by 
compensating for said lightness, saturation and hue with a maximum display luminance and a minimum 
display luminance of said display (7), a median value of the display luminance and a luminance of color 
image data. 
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FIG. 2 
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FIG. 3A 
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FIG. 4 
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